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Abstract. In this paper we address the basic geometric question of when a given convex 
set is the image under a linear map of an affine sUce of a given closed convex cone. Such a 
representation or "lift" of the convex set is especially useful if the cone admits an efficient 
algorithm for linear optimization over its affine slices. We show that the existence of a lift 
of a convex set to a cone is equivalent to the existence of a factorization of an operator 
associated to the set and its polar via elements in the cone and its dual. This generalizes a 
theorem of Yannakakis that established a connection between polyhedral lifts of a polytope 
and nonnegative factorizations of its slack matrix. Symmetric lifts of convex sets can also 
be characterized similarly. When the cones live in a family, our results lead to the definition 
of the rank of a c-onvcx set with respect to this family. Wc present results about this rank 
in the context of cones of positive semidefinite matrices. Our methods provide new tools for 
understanding cone lifts of convex sets. 



1. Introduction 

Linear optimization over convex sets plays a central role in optimization. In many in- 
stances, a convex set C C R" may come with a complicated representation that cannot be 
altered if one is restricted in the number of variables and type of representation that can be 
used. For instance, the n-dimcnsional cross-polytope 

Cn := {x e : ±Xi ± X2 ■ ■ ■ ± < 1} 

requires the above 2" constraints in any representation of it by linear inequalities in n vari- 
ables. However, C„ is the projection onto the ^-coordinates of the polytope 

n 

Qn ■= {{x,y) e M^"" : = < Xi < y^V i = 1, . . . ,n} 

i=l 

which is described by 2n + 1 linear constraints and 2n variables, and one can optimize a 
linear function {c,x) over C„ by instead optimizing it over Qn- Since the running time of 
linear programming algorithms depends on the number of linear constraints of the feasible 
region, the latter representation allows rapid optimization over C„. More generally, if a 
convex set C C can be written as the image under a linear map of an affine slice of a 
cone that admits efficient algorithms for linear optimization, then one can optimize a linear 
function efficiently over C as well. For instance, linear optimization over affine slices of the 
/c-dimensional nonnegative orthant is linear programming, and over the cone of k x k 
real symmetric positive semidefinite matrices is semidefinite programming, both of which 
admit efficient algorithms. Motivated by this fact, we ask the following basic geometric 
questions about a given convex set C C M"^: 
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(1) Given a full- dimensional closed convex cone K C M™, when does there exist an affine 
subspace L C and a linear map vr : — )• M" such that C = n{K H L)? 

(2) If the cone K comes from a family {K^.) (e.g. (M^) or {S'^)), then what is the least 
k for which C = tt^Kj. fl L) for some it and L ? 

If C = tt{K n L), then K (1 L is called a K-lift of C. In [30], Yannakakis points out 
a remarkable connection between the smallest k for which a polytope has a M^-lift and 
the nonnegative rank of its slack matrix. The main result of our paper is an extension of 
Yannakakis' result to the general scenario of K being any closed convex cone and C any 
convex set, answering Question (1) above. The main tool is a generalization of nonnegative 
factorizations of nonnegative matrices to cone factorizations of slack operators of convex sets. 



This paper is organized as follows. In Section [2] we present our main result (Theorem 2.4) 
characterizing the existence of a i^'-lift of a convex set C C M", when is a full-dimensional 
closed convex cone in W^. A i^-lift of C is symmetric if it respects the symmetries of 



C. In Theorem |2.12[ we characterize the existence of a symmetric K-lift of C. Although 
symmetric lifts are quite special, they have received much attention. The main result in [30j 
was that a symmetric M^-lift of the matching polytope of the complete graph on n vertices 
requires k to be at least exponential in n. Results in |T7] and |2l] have shown that symmetry 



imposes strong restrictions on the minimum size of polyhedral lifts. Proposition 2.8 describes 
geometric operations on convex sets that preserve the existence of cone lifts. 



In Section [3] we focus on polytopes. As a corollary of Theorem |2.4 we obtain Theorem 3.3 



which generalizes Yannakakis' result for polytopes [301 Theorem 3] to arbitrary closed convex 



cones K. We illustrate Theorems |3.3| and 2.12 using polygons in the plane. 



Section |4] tackles Question (2) and considers ordered families of cones, /C = (Kk), that can 
be used to lift a given C C M", or more simply, to factorize a nonnegative matrix M. When 
all faces of all cones in K, are again in /C, we define rankx:(C) (respectively, rankx:(M)) to be 
the smallest k such that C has a i^fc-lift (respectively, M has a i^^-factorization) . We focus 
on the case of /C = (M^) when rankx:(-) is called nonnegative rank, and K, = (S^) when 



rankx:(-) is called psd rank. Section 4.1 gives the basic definitions and properties of cone 
ranks. We find (different) families of nonnegative matrices that show that the gap between 
any pair among: rank, psd rank and nonnegative rank, can become arbitrarily large. In 



Section |4.2| we derive lower bounds on nonnegative and psd ranks of polytopes. We note 
that the nonnegative rank of a polytope is also called the extension complexity of the polytope 
by some authors in reference to this invariant being the smallest k for which the polytope 



admits a M^-lift. Corollary 4.13 shows a lower bound for the nonnegative rank of a polytope 
in terms of the size of an antichain of its face lattice. Corollary |4.18 gives an upper bound 



on the number of facets of a polytope with psd rank k. This subsection also finds families of 
polytopes whose slack matrices exhibit arbitrarily large gaps between rank and nonnegative 
rank, as well as rank and psd rank. 

In Section |5] we give two applications of our methods. When C = STAB(G') is the stable 
set polytope of a graph G with n vertices, Lovasz constructed a convex approximation of G 
called the theta body of G. This body is the projection of an affine slice of iS""^^, and when 
G is a perfect graph, it coincides with STAB(G'). Our methods show that this construction 
is optimal in the sense that for any G, STAB(G') cannot admit a iS^-lift for any k < n. A 
result of Burer shows that every STAB(G) has a Q^^^-lift where C^_^_l is the cone of completely 



positive matrices of size (n-|- 1) x (n+ 1). We illustrate Burer's result in terms of Theorem 2.4 



on a cycle of length five. The second part of Section [5] interprets Theorem 2.4 in the context 
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of rational lifts of convex hulls of algebraic sets. We show in Theorem |5.6 that in this case, 
the positive semidefinite factorizations required by Theorem 2.4 can be interpreted in terms 
of sums of squares polynomials and rational maps. 

In the last few decades, several lift- and- project methods have been proposed in the opti- 
mization literature that aim to provide tractable descriptions of convex sets. These methods 
construct a series of nested convex approximations to C C that arise as projections of 
higher dimensional convex sets. Examples can be found in [H EHl EOl UHl [231 113 HE] and 
[7]. In these methods, C is either a 0/1-polytope or more generally, the convex hull of a 
semialgebraic set, and the cones that are used in the lifts are either nonnegative orthants or 
the cones of positive semidefinite matrices. The success of a lift-and-project method relies 
on whether a lift of C is obtained at some step of the procedure. Questions (1) and (2), 
and our answers to them, address this convergence question and offer a uniform framework 
within which to study all lift-and-project methods for convex sets using closed convex cones. 

There have been several recent developments that were motivated by the results of Yan- 
nakakis in [30]. As mentioned earlier, Kaibel, Pashkovich and Theis proved that symmetry 
can impose severe restrictions on the minimum size of a polyhedral lift of a polytope. An 
exciting new result of Fiorini, Massar, Pokutta, Tiwary and de Wolf shows that there are cut, 
stable set and traveling salesman polytopes for which there can be no polyhedral lift of size 
polynomial in the number of vertices of the associated graphs. Their paper [12] also gives 
an interpretation of positive semidefinite rank of a nonnegative matrix in terms of quantum 
communication complexity extending the connection between nonnegative rank and classical 
communication complexity established in 



2. Cone lifts of convex bodies 

A convex set is called a convex body if it is compact and contains the origin in its interior. 
To simplify notation, we will assume throughout the paper that the convex sets C C M" for 
which we wish to study cone lifts are all convex bodies, even though our results hold for all 
convex sets. Recall that the polar of a convex set C C is the set 

C° = {yeW: (x, y) < 1, Va; G C}. 

Let ext(C) denote the set of extreme points of C, namely, all points p E C such that if 
P = {Pi + P2)/2, with pi,p2 € C, then p = pi = P2- Since C is compact with the origin in 
its interior, both C and C° are convex hulls of their respective extreme points. Consider the 
operator S' : M" x M" — )• M defined by S{x,y) = 1 — {x,y). We define the slack operator Sc, 
of the convex set C, to be the restriction of S to ext(C) x ext(C°). 

Definition 2.1. Let K C be a full-dimensional closed convex cone and C C a full- 
dimensional convex body. A K-lift of C is a set Q = K (1 L, where L C is an affine 
subspace, and tt : IR*" — )■ M" is a linear map such that C = tt{Q). If L intersects the interior 
of K we say that Q is a proper K-lift of C. 

We will see that the existence of a i^-lift of C is intimately connected to properties of the 
slack operator Sc- Recall that the dual of a closed convex cone K C M."^ is 

K* = {yeR"' : {x, y) > 0, Vx G K}. 

A cone K is self-dual if K* = K. In particular, the cones and S'l are self-dual. 
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Definition 2.2. Let C and K be as in Definition 2.1[ We say tliat tlie slack operator Sc is 
K -factorizable if tliere exist maps (not necessarily linear) 

A : ext(C) ^ K and B : ext(C°) ^ K* 

such that Sc{x,y) = {A{x), B{y)) for all {x,y) G ext(C) x ext(C°). 

Remark 2.3. The maps A and -B may be defined over all of C and C° by picking a repre- 
sentation of each x & C (similarly, y G C°) as a convex combination of extreme points of C 
(respectively, C°) and extending A and B linearly. Such extensions are not unique. 

With the above set up, we can now characterize the existence of a K-liit of C. 

Theorem 2.4. // C has a proper K-lift then Sc is K -factorizable. Conversely, if Sc is 
K -factorizable then C has a K-lift. 

Proof: Suppose C has a proper i^'-lift. Then there exists an affine space L = wq -\- Lq in 
M™ (Lq is a linear subspace) and a linear map vr : — )■ M" such that C = it{K fl L) and 
Wo G int(-ft'). Equivalently, 

C = {s G : a; = 7r(w), w e K n [wq + Lo)}. 

We need to construct the maps A : ext(C) — K and B : ext(C°) — ?■ K* that factorize the 
slack operator Sc, from the K-hft of C. For Xj G ext(C), define A{xi) := Wj, where Wi is 
any point in the non-empty convex set 7^~^{xi) (1 K (1 L. 

Let c be an extreme point of C°. Then max{ (c, x) : x G C} = 1 since (c, x) < 1 for all 
X G C, and if the maximum was smaller than one, then c would not be an extreme point of 
C°. Let M be a full row rank matrix such that kerM = Lq. Then the following hold: 

1= max(c, x) = max(c, 7r(t(;)) = max(7r*(c), if) 

X G C w e K n {wo Lo) Mw = Mwq 

w e K 

Since wq lies in the interior of K, by Slater's condition we have strong duality, and we get 

1 = min {Mwq, y) : M^y - 7r*(c) G K* 

with the minimum being attained. Further, setting z = M'^y we have that 

1 = min {wo, z) : z — vr*(c) G K*, z G Lq 

with the minimum being attained. Now define B : ext(C°) — > K* as the map that sends 
yi G ext(C°) to B{yi) := z — 7r*(?/j), where z is any point in the nonempty convex set 
Lq n {K* + n*{yi)) that satisfies {wq,z) = 1. Note that for such a z, {wi,z) = 1 for all 
Wi G L. Then -B(?/i) G -R'*, and for an Xj G ext(C), 

{xi,yi) = {■n{w{),yi) = {w^,TC*{yi)) = {wi,z-B{yi)) 
= 1 - {w„B{y,)) = 1 - {A{x,),B{y,)). 

Therefore, Sc{xi,yi) = 1 - (xj,?/i) = {A{xi), B^yi)) for all Xj G ext(C) and y^ G ext(C°). 

Suppose now Sc is /T-factorizable, i.e., there exist maps A : ext(C) — ?■ and i? : 
ext(C°) ir* such that Sc{x,y) = {A{x),B{y)) for all {x,y) G ext(C) x ext(C°). Consider 
the affine space 

L = {(x, z) G X M™ : 1 - (x, y) = {z, B{y)) , W y e ext(C°)}, 
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and let Lk be its coordinate projection into W^. Note that ^ Lk since otherwise, there 
exists X G such that 1 — {x,y) = for all y G ext(C°) which implies that C° lies in 
the affine hyperplane {x,y) = 1. This is a contradiction since C° contains the origin. Also, 
K n Lk 7^ since for each x G ext(C), A{x) G K n Lk by assumption. 

Let X be some point in M" such that there exists some z & K for which (x, z) is in L. 
Then, for all extreme points y of C° we will have that 1 — (x, y) is nonnegative. This implies, 
using convexity, that 1 — {x,y) is nonnegative for all y in C°, hence x G (C°)° = C. 

We now argue that this implies that for each z & K r\ Lk there exists a unique Xz G M" 
such that {xz,z) G L. That there is one, comes immediately from the definition of Lk- 
Suppose now that there is another such point x'^. Then {tx^ + (1 — 't)^'^, z) E L for all reals t 
which would imply that the line through Xz and x'^ would be contained in C, contradicting 
our assumption that C is compact. 

The map that sends z to Xz is therefore well-defined in KCiLk, and can be easily checked 
to be affine. Since the origin is not in Lk, we can extend it to a linear map tt : M™" — t- M". 
To finish the proof it is enough to show C = tt{K n Lk)- We have already seen that 
7r{K (1 Lk) C C so we just have to show the reverse inclusion. For all extreme points x of C, 
A{x) belongs to KDLk, and therefore, x = 7i{A{x)) G n{K n Lk)- Since C = conv(ext(C)) 
and ni^K fl Lk) is convex, C C n{K fl Lk)- □ 



The restriction to proper lifts in Theorem 2.4 is not important if the cone K has a well- 



understood facial structure as in the case of nonnegative orthants and cones of positive 
semidefinite matrices. If there exists a i^-lift that is not proper, then there is a proper lift 
to a face of K and we could pass to this face to obtain a cone factorization. Since our proof 
uses strong duality, it is not obvious how to remove the properness assumption for a general 
closed convex cone. However, there is a situation under which properness can be dropped. 

Definition 2.5. [8J A cone K is nice if K* + F-^ is closed for all faces F of K. 

Corollary 2.6. If K is a nice cone, then whenever C has a K-lift (not necessarily proper), 
Sc has a K -factorization. 

Proof: In [23] Pataki notes that K is nice if and only if F* = K* + F-^ for all faces F of K. 
Let A : ext(C) — F and B : ext(C°) — ?• F* be the F-factorization of Sc from the proper lift 
of C to a face F of K. Then A is also a map from ext(C) to K. Define B' : ext(C°) — K* 
as B'{y) = z e K* such that B{y) - z e F^. Then {A{x),B{y)) = {A{x),B'{y)) for all 
{x,y) G ext(C) x ext(C°) and we obtain a /^-factorization of ^c- □ 

Polyhedral cones, second order cones and the cones of real symmetric psd matrices S'l 
are all nice. In [25] Pataki shows that if a cone is nice then all its faces are exposed and he 
conjectures that the converse is also true. 



We now present a simple illustration of Theorem 2.4 using K = S^. 
Example 2.7. Let C be the unit disk in which can be written as 



y 1 — X 

This means that Sc must have a factorization. Since C° = C, ext(C) = ext(C°) = dC, 
and so we have to find maps A, B : ext(C) — )■ such that for all (xi, yi), {x2, 2/2) £ ext(C), 

{A{xi, yi), B{x2, 1/2)) = 1 - X1X2 - ym- 
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But this is accomplished by the maps 
and 



l + xi yi 
yi l-xi 



2\ -y2 1 + X2 

which factorize Sc and can easily be checked to be positive semidefinite in their domains. 

The lifts of convex bodies are preserved by many common geometric operators. 

Proposition 2.8. If Ci and C2 are convex bodies, and Ki and K2 are closed convex cones 
such that Ci has a Ki-lift and C2 has a K2-lift, then the following are true: 

(1) If IT is any linear map, then vr(Ci) has a Ki-lift; 

(2) CI has a K*-lift; 

(3) Every exposed face of Ci has a Ki-lift; 

(4) The cartesian product Ci x C2 has a Ki x K2-lift; 

(5) The Minkowski sum Ci + C2 has a Ki x K2-lift; 

(6) The convex hull conv(Ci U C2) has a Ki x K2-lift. 

Proof: The first property follows immediately from the definition of a i^i-lift. The second 



is an immediate consequence of Theorem 2.4 For the third property, if a face F of Ci is 



exposed, then F = Ci fl if where if is a hyperplane in W^. If i^i fl L is a i^i-lift of C, then 
Ki n L' is a i^i-lift of F where V is the affine space obtained by adding the equation of H 
to the equations defining L. The fourth property is again easy to derive from the definition 
since, if Ci = 7Ti{KinLi) and C2 = 7r2(i^2nL2), then Ci x C2 = (tti x 7r2)(i^i xK2nLiX L2). 
The fifth one follows from (1) and the fact that the Minkowski sum Ci + C2 is a linear image 
of the cartesian product Ci x C2. 

For the sixth, we use the fact that conv(Ci U €2)° = C° fl Cg. Given factorizations 
Ai,Bi of S'ci and A2,i?2 of S'ca, we have seen that we can extend Ai to all of Cj, and Bi 
to all of C°, and get that 1 — (x,?/) = {Ai{x), Biiy)) for all (x, ?/) G Q x C°. Furthermore, 
extend Ai to conv(Ci U C2) by defining it to be zero outside Ci and set A2 to be zero 
outside C2 \ Ci. Then, since ext(conv(Ci U C2)) C ext(Ci) U ext(C2) and ext{C^ n C°) is 
contained in both and C2, the maps, (^1,^2) : ext(conv(Ci U C2)) — )■ i^i x i^2 and 
{Bi, B2) : ext(conv(Ci U 6*2)°) KI x give a i^i x if2 factorization of 5'conv(CiUC2)- ^ 



Explicit constructions of the lifts guaranteed in Proposition 2^ can be found in the work 
of Ben-Tal, Nesterov and Nemirovski; see e.g. [Sj |22]. They were especially interested in 
the case of lifts into the cones of positive semidefinite matrices. Of significant interest is 
the relationship between lifts and duality, particularly when considering a self-dual cone K. 



When K is self dual. Theorem 'lA shows that the existence of a i^-lift is a property of both 
the convex body and its polar making the theory invariant under duality. We now examine 
the behavior of cone lifts under projective transformations. 

Proposition 2.9. Let C C M" he a convex body with a K-lift where K C M™ is a closed 
convex cone. If U is a projective transformation with n(C) compact, then n(C) has a K-lift. 



Proof: Without loss of generality we may assume the lift to be proper by passing to 
the smallest face of K containing the lift of C. Then, by Theorem 2.4 there exists maps 
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A : ext(C) — )■ K and B : ext(C°) — )■ i^* factorizing Sc, and we can extend their domains 



to C and C° as noted in Remark |2.3[ Recall that a real projective transformation 11 in 
is a map sending x to Px/ (1 + (c, x)) where P is some n x n (invertible) real matrix, and c 
a vector in M" . The compactness of n(C) is equivalent to 1 + (c, x) not vanishing on C and 
so we may assume without loss of generality that 1 + (c, x) is positive on C. 

Since for y G n(C)° and x G C, < 1 - {y, U{x)) = 1 - = ^^^ZlcS^"" ^ ^^^^ ^^^^ 

(P-^y — c, x) < 1, and therefore, Zy := P^y — c G C°. Consider the maps A' : n(C) — > and 
B' : n(C)° ^ K* given by A'(x) = A{U-\x))/{l + (c,n-i(x))) and P'(?/) = B{zy). These 
maps form a i^'-factorization of 5'n(c) and hence, n(C) has a i^-lift by Theorem 



2.4 



The 

case of affine transformations is trivial, but can be seen as a particular case of the projective 
case we just proved. □ 

A restricted class of lifts that has received much attention is that of symmetric lifts. The 
idea there is to demand that the lift not only exists, but also preserves the symmetries of the 
object being lifted. Several definitions of symmetry have been studied in the context of lifts 



to nonnegative orthants in papers such as [30], [T7j and [21]. Theorem 2.4 can be extended 
to symmetric lifts. 

Let G be a subgroup of GL„ acting on ext(C). A simple example of such a group would be 
Aut(C), the group of all rigid linear transformations (f of M" such that <f{C) = C, restricted 
to ext(C). Any such group G is compact, hence has a unique measure fic, its Haar measure, 
such that nciG) = 1 and fiQ is invariant under multiplication, i.e., ficigU) = f^ciU) for all 
g & G and all U G. Note that allowing affine transformations instead of linear ones, would 
not be essentially different, as any group of affine transformations acting on a compact set 
has a common fixed point, so after a translation of G it would be simply a subgroup of GL„. 

Definition 2.10. Let K he a. closed convex cone and G a convex body, such that G = 
tt{K n L) for some affine subspace L and linear map vr. Furthermore, let G C GL„ be a 
group acting on ext(C) and H C GL^ a group acting on K. We say that the lift K (IL of G 
is (G, H) -symmetric if there exists a group homomorphism from G to H sending G G to 
f^EH such that f^{Kr\L) = KDL and Tiof^ = ipon, when restricted to KnLnTT~^{ext{G)). 
We will say the lift is symmetric if it is (Aut(G), Aut(fC))-symmetric. 

The lifts obtained from the traditional lift-and-project methods mentioned in the Intro- 



duction are often symmetric in the sense of Definition 2.10 so it makes sense to study such 
lifts. In order to get a symmetric version of Theorem 2^, we have to introduce a notion of 
symmetric factorization of Sc- 



Definition 2.11. Let G, K, G and H be as in Definition |2.10| and A : ext(G) K 
and B : ext(G°) — )■ K* a i^-factorization of Sc- We say that the factorization is {G,H)- 
symmetric if there exists a group homomorphism from G to H sending (p E G to f^ E H such 
that Ao if = f^p o A. Call the factorization symmetric if it is (Aut(G), Aut(i^'))-symmetric. 

Note that any action of G C GL„ on G defines trivially an action of G on G°, and similarly 
any action of H C GL^ on K defines an action on K*. With these actions we can see that 
if a i^-factorization is (G, if)-symmetric in the sense of the previous definition, the group 



homomorphism / would also verify B o ip = f^ o B. Hence, Definition 2.11 is actually 
invariant with respect to polarity, even if it seems to only depend on the map A. This 
observation would still be true if we had considered G and H to be subgroups of projective 
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transformations of M" and respectively, but general linear groups are enough to cover all 



interesting examples we know. We can now establish the symmetric version of Theorem 2.4 



Theorem 2.12. IfC has a proper {G, H) -symmetric K-lift then Sc has a {G, H)-symmetric 
K -factorization. Conversely, if Sc has a {G, H)- symmetric K -factorization then G has a 
{G, H)- symmetric K-lift. 

Proof: First suppose that G has a proper (G, if)-symmetric i^'-lift with G = tt{K fl L). 
For each orbit of the action of the group G on ext(C), pick a representative Xq, and let 
A'{xo) be any point in K H L such that h^A'^xq)) = Xq. Let G^o C G be the subgroup of all 
automorphisms that fix xq. Then we can define 



A{xo) := / f^{A'{xo))dfiGx, 

which generalizes the construction in [30| Step 2, pp 449]. For a finite group, this is just 
the usual average of all images of A\xo) under the action of G^a- For any other point x' in 
the same orbit as Xq, pick any ip such that ip{xo) = x' and define A{x') := f^{A{xo)). The 
point A{x') in i^' n L does not actually depend on the choice of ip. To see this it is enough 
to note that o A{xo) = A{xo) for all /i G G^q and if ipi and ip2 both send xq to x', then 
° U2 = /v^rVa ^i~V2 is in G^g. 



Since KnL is a proper lift of G, we know we have a /^-factorization of Sc by Theorem |2. 4 
If we follow the proof of that result, we see that it is actually constructive, in the sense that 
we can pick as a map from ext(G) — )■ K any section of the projection vr. In particular, we 
can pick the map A we just defined, since we have 7t{A{x)) = x for every x G ext(G). This 
means that such a map A can be extended to a i^-factorization A, B of Sc- For any /i G G 
and X G ext(G), we have A o /^(x) = Ao ipi^xo), for some ip and Xq in the orbit of x and 
so, by the above considerations, 

A o = f^^^ o A{xq) = ff,o f^o A{xo) = f^,o A{ipxo) = f^o A{x), 

and hence, we have a (G, if)-symmetric i^-factorization of Sc- 

Suppose now we have a (G, if)-symmetric ii"-factorization of Sc- Since it is in particular 



a i^-factorization of Sc, we have a i^-lift K fl L of G by Theorem 2A From the proof of that 
theorem we know that A{x) is in flL for all x G ext(G). Let L' be the afiine subspace of L 
spanned by all such points A{x)- It is clear from the definition that L' is invariant for all 
ip & G. Furthermore, given any ?/ G L' we can write it as an affine combination aiA{xi) 
for some Xi in ext(G), and so for all (/9 G G, we have 



TT 



which is simply the image of 7i{y) under (p. Hence, K n L' is a (G, if)-symmetric lift of G. 

□ 



3. Cone lifts of polytopes 

The results developed in the previous section for general convex bodies specialize nicely 
to polytopes, providing a more general version of the original result of Yannakakis relating 
polyhedral lifts of polytopes and nonnegative factorizations of their slack matrices. We first 
introduce the necessary definitions. 
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For a full-dimensional polytope P in M"-, let Vp = {pi, . . . be its set of vertices, Fp 
its set of facets, and / := \Fp\. Recall that each facet Fi in Fp corresponds to a unique 
(up to multiplication by nonnegative scalars) linear inequality hi{x) > that is valid on P 
such that Fj = {x G P : hi{x) = 0}. These form (again up to multiplication by nonnegative 
scalars) the unique irredundant representation of P as 

P = {xe M" ■.hi{x)>0,..., hf{x) > 0}. 

Since we are assuming that the origin is in the interior of P, hi{0) > for each i = 1, . . . , f . 
Therefore, we can make the facet description of P unique by normalizing each hi to verify 
hi{0) = 1. We will call this the canonical inequality representation of P. 

Definition 3.1. Let P be a full-dimensional polytope in with vertex set Vp = {pi, . . . ,py} 
and with an inequality representation 

P = {xE M" : /ii(x) > 0, . . . , hf{x) > 0}. 

Then the nonnegative matrix in whose (i,j)-entry is hj{pi) is called a slack matrix of 
P. If the hi form the canonical inequality representation of P, we call the corresponding 
slack matrix the canonical slack matrix of P. 

In the case of a polytope P, ext(P) is just Vp, and the elements of ext(P°) are in bijection 
with the facets of P. This means that the operator Sp is actually a finite map from Vp x Fp to 
M+ that sends a pair {pi,Fj) to hj{pi), where hj is the canonical inequality corresponding to 
the facet Fj. Hence,we may identify the slack operator of P with the canonical slack matrix 
of P and use Sp to also denote this matrix. We now need a definition about factorizations 
of non-negative matrices. 

Definition 3.2. Let M = (Mij) G M.^*^ be a nonnegative matrix and K a closed convex cone. 
Then a K- factorization of M is a pair of ordered sets a^, . . . , G K and 6^, . . . , 6'^ G K* 
such that {a\b^) = Mij. 

Note that M G M.^'^ has a Mi-factorization if and only if there exist a p x k nonnegative 



matrix A and a k x q nonnegative matrix B such that M = AB. Therefore, Definition 3^ 
generalizes nonnegative factorizations of nonnegative matrices to arbitrary closed convex 
cones. Since any slack matrix of P can be obtained from the canonical one by multiplication 
by a diagonal nonnegative matrix, it is i^-factorizable if and only if Sp is i^-factorizable. 



We can now state Theorem 2.4 for polytopes. 



Theorem 3.3. // a full- dimensional polytope P has a proper K-lift then every slack matrix 
of P admits a K -factorization. Conversely, if some slack matrix of P has a K -factorization 
then P has a K-lift. 



Theorem |3.3| is a direct translation of Theorem |2.4| using the identification between the 
slack operator of P and the canonical slack matrix of P. The original theorem of Yannakakis 
[30t Theorem 3] proved this result in the case where K was some nonnegative orthant ML. 
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Example 3.4. To illustrate Theorem 3^ consider the regular hexagon in the plane with 
canonical inequality description 

/I 73/3 \ 
2^3/3 
-1 v/3/3 / Xi 
-1 -V3/3 V ^2 
-2^3/3 
V 1 -v^/3 / 

We will denote the coefficient matrix by F and the right hand side vector by d. It is easy to 
check that H cannot be the projection of an affine slice of for k < 5. Therefore, we ask 
whether it can be the linear image of an affine slice of , which turns out to be surprisingly 
non-trivial. Using Theorem 3^ this is equivalent to asking if the canonical slack matrix of 
the hexagon, 

/ 1 2 2 1 
1 



/1\ 

1 

1 
1 
1 

V 1 / 



s 



H 



has a Mi-factorization. Check that 
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/ 1 2 1 \ 
12 10 
110 
10 10 
1 / 




\ 1 



where we call the ffist matrix A and the second matrix B. We may take the rows of A as 
elements of M^, and the columns of B as elements of = (M^)*, and they provide us a 
M^-factorization of the slack matrix Sh, proving that this hexagon has a M^-lift while the 
trivial polyhedral lift would have been to M^. 

We can construct the lift explicitly using the proof of the Theorem |2.4[ Note that 

H = {{xi, X2) eR^ -.3 y eRl s.t. Fx + B^y = d}. 

Hence, the exact slice of that is mapped to the hexagon is simply 

{y G M+ : 3 a; G s.t. B^y = d- Fx}. 

By eliminating the x variables in the system we get 

{y eRl : yi+y2 + y3 + y5 = 2, 1/3 + 1/4 + 2/5 = 1}, 

and so we have a three dimensional slice of M.\ projecting down to H. This projection is 
visualized in Figure [TJ 

The hexagon is a good example to see that the existence of lifts depends on more than 
the combinatorics of the facial structure of the polytope. If instead of a regular hexagon we 
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Figure 1. Lift of the regular hexagon. 



Figure 2. Irregular hexagon with no M^-lift. 

take the hexagon with vertices (0,-1), (1,-1), (2,0), (1,3), (0,2) and (—1,0), as seen in 
Figure |2| a valid slack matrix would be 



S : = 
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One can check that if a 6 x 6 matrix with the zero pattern of a slack matrix of a hexagon 
has a M^-factorization, then it has a factorization with either the same zero pattern as the 
matrices A and B obtained before, or the patterns given by applying a cyclic permutation 
to the rows of A and the columns of B. A simple algebraic computation then shows that the 
slack matrix S above has no such decomposition hence this irregular hexagon has no M^-lift. 

Symmetric lifts of polytopes are especially interesting to study since the automorphism 
group of a polytope is finite. We now show that there are polygons with n sides for which a 
symmetric M^-lift requires k to be at least n. 

Proposition 3.5. A regular polygon with n sides where n is either a prime number or a 
power of a prime number cannot admit a symmetric M.^-lift where k < n. 
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Proof: A symmetric M^-lift of a polytope P implies the existence of an injective group 
homomorphism from Aut(P) to Aut(]R^). Since the rigid transformations of are the 
permutations of coordinates, Aut(M^) is the symmetric group S^- This imphes that the 
cardinahty of Aut(P) must divide k\. 

Let P be a regular p-gon where p is prime. Since Aut(P) has 2p elements, and the smallest 
k such that 2p divides k\ is p (since p > 2), we can never do better than a symmetric M?j_-lift 
for P. If P is a p*-gon, then the homomorphism from Aut(P) to Sk must send an element of 
order to an element whose order is a multiple of p*. The smallest symmetric group with 
an element of order is Spt and hence, P cannot have a symmetric M^-lift with k <p*. □ 

In Example 3.4 we saw a Ml-lift of a regular hexagon, but notice that the accompanying 



factorization is not symmetric. 

Remark 3.6. Ben-Tal and Nemirovski have shown in [6] that a regular n-gon admits a 



^^-lift where k = 0(log n). Combining their result with Proposition 3.5 provides a simple 
family of polytopes where there is an exponential gap between the sizes of the smallest 
possible symmetric and non-symmetric lift into nonnegative orthants. This provides a simple 
illustration of the impact of symmetry on the size of lifts, a phenomenon that was investigated 
in detail by Kaibel, Pashkovich and Theis in [T7] . 

4. Cone ranks of convex bodies 

In Section |2] we established necessary and sufficient conditions for the existence of a i^-lift 
of a given convex body C C M" for a fixed cone K. In many instances, the cone K belongs 
to a family such as or In such cases, it becomes interesting to determine the 

smallest cone in the family that admits a lift of C. In this section, we study this scenario 
and develop the notion of cone rank of a convex body. 

4.1. Definitions and basics. 

Definition 4.1. A cone family /C = (frj)jgN is a sequence of closed convex cones Ki indexed 
by z G N. The family /C is said to be closed if for every i G N and every face F of there 
exists j < i such that F is isomorphic to Kj. 

Example 4.2. 

(1) The set of nonnegative orthants (M^, z G N) form a closed cone family. 

(2) The family {S]_,i G N) where S\. is the set of all i x i real symmetric positive 
semidefinite matrices is closed since every face of S\_ is isomorphic to a 5+ for j < i 
P Chapter 11.12]. 

(3) Recall that a. i x i symmetric matrix A is copositive if Ax > for all x G M!,_. Let 
the cone of i x i symmetric copositive matrices be denoted as Cj. This family is not 
closed — the set of alH x i matrices with zeroes on the diagonal and nonnegative 
off-diagonal entries form a face of Cj that is isomorphic to the nonnegative orthant 
of dimension (*) • 

(4) The dual of Cj is the cone C* of all completely positive matrices which are exactly 
those symmetric i x i matrices that factorize as BB^ for some B G MV^^ The 
family (C*, i G N) is also not closed since dimC* = (*) while C* has facets (faces of 
dimension (*) — 1) which therefore, cannot belong to the family. 



Recall the definition of a cone factorization of a nonnegative matrix in Definition 3.2 
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Definition 4.3. Let /C = (i^i)jgN be a closed cone family. 

(1) The /C-rank of a nonnegative matrix M, denoted as rankx:(M), is the smallest i such 
that M has a i^j-factorization. If no such i exists, we say that rankx:(M) = +oo. 

(2) The /C-rank of a convex body C C M", denoted as rank/c(C), is the smallest i such 
that the slack operator Sc has a Kj-factorization. If such an i does not exist, we say 
that TdJokfciC) = +00. 

In this paper, we will be particularly interested in the families /C = (M^) and /C = (5+). 
In the former case, we set rank_|_(-) := rankyc(-) and call it nonnegative rank, and in the latter 
case we set rankpsd(-) := rankx:(-) and call it psd rank. Our interest in cone ranks comes from 



their connection to the existence of cone lifts. The following is immediate from Theorem 2.4 



Theorem 4.4. Let JC = {Ki)i>Q be a closed cone family and C C M" a convex body. Then 
rankle (C) is the smallest i such that C has a Ki-lift. 

Proof: If i = rank/c(C), then we have a i^Tj-factorization of the slack operator Sc, and 



therefore, by Theorem 2.4, C has a i^'j-lift. Take the smallest j for which C has a iC,-lift 
and suppose j < i. If the lift was proper, we would get a Kj factorization of Sc for j < i, 
which contradicts that i = rank/c(C). Therefore, the i^j-lift of C is not proper, and C has 
a lift to a proper face of Kj. Since K, is closed, this would imply a Ki-\iit of C for / < j 
contradicting the definition of j. □ 

In practice one might want to consider lifts to products of cones in a family. This could be 
dealt with by defining rank as the tuple of indices of the factors in such a product, minimal 
under some order. In this paper we are mostly working with the families (W^) and (5!^), 
and in the first case, M!^ x M™ = M^+™, and in the second case, 5!^ x 5™ = 5+ +" n L where 
L is a linear space. Therefore, in these situations, there is no incentive to consider lifts to 
products of cones. However, if one wants to study lifts to the family of second order cones, 
considering products of cones makes sense. 

Having defined rankle (M) for a nonnegative matrix M, it is natural to ask how it compares 
with the usual rank of M. We now look at this relationship for the nonnegative and psd 
ranks of a nonnegative matrix. 

The nonnegative rank of a nonnegative matrix arises in several contexts and has wide 
applications ^lOj. As mentioned earlier, its relation to M^-lifts of a polytope was studied by 
Yannakakis [3D]. Determining the nonnegative rank of a matrix is NP-hard in general [29j . 
but there are obvious upper and lower bounds on it. 

Lemma 4.5. For any M G M^^'^, rank(M) < rank+(M) < mm{p,q}. 

Further, it is not possible in general, to bound rank+(M) by a function of rank(M). 

Example 4.6. Consider the nxn matrix M„ whose (i, j)-entry is {i—j)"^. Then rank(M„) = 
3 for all n since M„ = AnB^ where row i of An is (i^, — 2z, 1) for i = 1, . . . , n and column 
j of Bn is for j = 1, . . . ,n. If M„ has a M^-factorization, then there exists 

ai, . . . , a„, 6i, . . . , 6„ G M^f. such that (oj, bj) ^ for all i ^ j. Notice that for i j ii 
supp(6j) C supp(6j) then (aj, 6j) = implies (oj, bj) = 0, and hence, all the fej's (and also 
all the Oi's) must have supports that are pairwise incomparable. By Sperner's lemma, the 
largest antichain in the Boolean lattice of subsets of [k] has cardinality and thus we 

get that n < Therefore, rank+(M„) is bounded below by the smallest integer k such 
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that n < (i^fcj)- For large k, we have ^ y^" 2'', and the easy bound [^'t^) < 2^ yields 
rank_|_(M„) > log2n. 

The psd rank of a nonnegative matrix is connected to rank and rank_|_ as follows. 

Proposition 4.7. For any nonnegative matrix M 
1 1 

-a/1 + 8rank(M) - - < rankp^d(M) < rank+(M). 

Proof: Suppose ai, . . . ,ap,bi, . . . ,bq give a ]R'!j_-factorization of M G M.^'^. Then the 
diagonal matrices Ai := diag(aj) and Bj := diag(6j) give a 5!^-factorization of M, and we 
obtain the second inequality. 

Now suppose Ai, . . . Ap, Bi, . . . ,Bq give a 5!|l-factorization of M. Consider the vectors 

= {All, ■ ■ ■ , Arr, 2Ai2, . . . , 2Air, 2^23, . . . , 2A(^r-l)r) 

and 

bj = {Bii, . . . , Brr, Bi2, ■ ■ ■ , Bir, B23, ■ ■ ■ , B{r-l)r) 

in 2 ) where A = Ai and B = Bj. Then (oj, bj) = {Ai, Bj) = Mij so M has rank at most 
('''^^) . By solving for r we get the desired inequality. □ 

There is a simple, yet important situation where rank(M) is an upper bound on rankpsd(M). 

Proposition 4.8. Take M G MP^'^ and let M' be the nonnegative matrix obtained from M 
by squaring each entry of M. Then rankpsd(M') < rank(M). In particular, if M is a 0/1 
matrix, rankpsd(M) < rank(M). 

Proof: Let rank(M) = r and Vi, . . . ,Vp,Wi, . . . ,Wg G W be such that {vi,Wj) = M, 



Consider the matrices Ai = Vivf , i = 1,. . . ,p and Bj = WjwJ, j = 1, ... ,g in S!^. Then, 
since {Ai,Bj) = {vi,Wj)^ = M[j, the matrix M' has a iS!|l-factorization. □ 

Barvinok has generalized the above result in a recent preprint [2] to show that when the 
number of distinct entries in a nonnegative matrix M does not exceed k, then the psd rank 
of M is bounded above by {k-^+^^-^KM)y 

now see that the gap between the nonnegative 
and psd rank of a nonnegative matrix can become arbitrarily large. 

Example 4.9. Let be the n x n matrix, n > 2, whose (i, j)-entry is i — j. Then 
rank(£'„) = 2 since the vectors Oj := {i,—l), i = l,...,n and bj = (l,j), j = l,...,n 



have the property that {ai,bj) = i ~ j. Therefore, by Proposition 4.8, the matrix M„ with 
(i, j)-entry equal to {i — jY has psd rank two and an explicit iS^-factorization of M„ is given 
by the psd matrices 

Ai:= ( \ M , i = 1,. . . ,n and Bj := (\ ^.-^ j , j = l,...,n. 



However, we saw in Example 4.6 that rank+(M„) grows with n. A family of n x n matrices 
for which psd rank is O(logn) and nonnegative rank at least n'^o'^'^tant gjyg^ For 
the family {M„}, the gap between rank and psd rank can become arbitrary large. 

Thus, so far we have seen that the gap between rank(M) and rank_|_(M) as well as the gap 
between rankpsd(M) and rank_|_(M) can be made arbitrarily large for nonnegative matrices 
M. Results in the next subsection will imply that there are nonnegative matrices for which 
the gap between rank(M) and rankpsd(M) can also become arbitrarily large. 



LIFTS OF CONVEX SETS AND CONE FACTORIZATIONS 



15 



4.2. Lower bounds on the nonnegative and psd ranks of polytopes. A well-known 
lower bound to the nonnegative rank of a matrix is the Boolean rank of the support of the 
matrix. The support of a matrix M G M.^'^, is the Boolean matrix supp(M) obtained by 
turning every non-zero entry in M to a one. The rank of supp(M) in Boolean arithmetic 
(where 1 -|- 1 = 1 and all other additions and multiplications among and 1 are as for the 
integers) is called the Boolean rank of supp(M) (and also of M). In terms of factorizations, 
Boolean rank can be defined as follows. 

Definition 4.10. The Boolean rank of a matrix T G {0, I^p^'^ is the least integer r for which 
there exists A G {0, Ijp^'" and B G {0, ly^'^ such that T = AB where all additions and 
multiplications are in Boolean arithmetic. 

We will denote the Boolean rank of supp(M) as rankB(M). It is easy to see that 
ranks (M) < rank-|.(M). However, it is NP-hard to compute Boolean rank and most lower 
bounds to rank+(M) are, in fact, lower bounds to rankB(M). 

The ideas in Example 4. 6| provide an elegant way of thinking about lower bounds for the 



nonnegative rank of a polytope. Let C be a polytope and let L{C) be its face lattice. If C 
has a lift as C = 7r(]R^ fl L), then the map vr"^ sends faces of C to faces of fl L. Since 
each face of fl L is the intersection of a face of with L, the map vr"^ is an injection 
from L{C) to the faces of M^. The faces of can be identified with subsets of [k] as they 
are of the form Fj = {x G M^f. : supp(a;) C J} for J C [k]. So the map 7r~^ determines an 
embedding of the lattice L(C) into 2['^1, the Boolean lattice of subsets of [k]. 

Theorem 4.11. For a polytope C , there is a Boolean factorization o/supp(S'c) of interme- 
diate dimension k if and only if there is a lattice embedding of L{C) into 2^'^^. 

Proof: In this proof it is convenient to identify a subset U of [k] with its incidence vector in 
{0, l}'^ defined as having 1 in position i if and only if i & U. Given an embedding of L{C) 
into 2'^!, a Boolean factorization AB of supp(S'c) is gotten by taking the row of A indexed 
by vertex f of C to be 0(f), and the column of B indexed by facet F of C to be [k]\(j){F). 
Then the {v, F) entry of supp(M) is zero if and only if (f){v) C 0(F) if and only if f G F. 

Suppose now we have a Boolean factorization AB of supp(S'p) of intermediate dimension 
k. For every face F of P define 

0(F) := U A{v) 

where A{v) denotes the row of A indexed by vertex v. Clearly H C F implies 0(-ff) C (j){F). 
To see the reverse inclusion, suppose H <^ F. Pick a vertex w & H \ F and a facet F 
containing F but not w. Let B{F) denote the column of B indexed by facet F. Since 
A{w) n B{F) ^ 0, we have 0(if) fl B{F) 0. On the other hand,^for aU G F, we 
have f G F which implies that A[v) fl -B(F) = and so, 0(F) fl -B(F) = 0. Therefore, 
0(-f^) 2 completing the proof. □ 



Theorem 4.11 immediately yields a lower bound on the nonnegative rank of a polytope 
based solely on the facial structure of the polytope. 

Corollary 4.12. Let C C 6e a polytope and k the smallest integer such that there exists 
an embedding of the face lattice L{C) into the Boolean lattice 2^'^'^. Then rank_|_(C) > k. 

The Boolean rank of a 0/1 matrix is also called its rectangle covering number. Theorem 
2.9 in [TT] phrases a version of the above results in terms of rectangle covering number. 
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Corollary 4.13. If C C M" is a polytope, then the following hold: 

(1) Let p be the size of a largest antichain of faces of C (i.e., a largest set of faces such 
that no one is contained in another). Then rank_|_(C) is bounded below by the smallest 
k such that p < 

(2) (Goemans Let uq be the number of faces of C, then rank+(C) > log2{nc)- 



Proof: The first bound follows from Corollary 4.12 since lattice embeddings preserve 
antichains, and the size of the largest antichain of the Boolean lattice 2^'^^ is (Sperner's 

lemma). The second bound follows from the easy fact that any embedding of L{C) into 2^^^ 
requires #L(C) < 2K □ 

Note that a (weaker) version of the first bound can be found in [131 Corollary 4] with the 
size of the largest antichain replaced by the number of vertices. As mentioned, the second 
lower bound essentially appears in [13] . Further lower bounds for the nonnegative rank of a 



polytope are overviewed in [II]. The two bounds in Corollary |4.13 are in general different. 
For instance, if C is a square in the plane, the Goemans bound says that rank_(_(C) > 
log2(10) ~ 3.32 while the antichain bound says that rank+(C) > 4, and thus both give 
the same value after rounding up. For C a three-dimensional cube, log2(28) = 4.807355 
while the maximum size of an antichain of faces is 12 (take the 12 edges) and hence, the 
antichain lower bound is 6. Although the antichain bound can be better than Goemans' 
(as this example shows), asymptotically they are roughly equivalent. To see this, we notice 
that if p ^ ' ^^^^ asymptotic expansion yields ~ Ci + logj P + ^ log2(C'2 + 2 logp), 
for some small explicit constants Ci and C2. Since p (antichain size) is always less than or 
equal to the number of faces nc, we have log2P < log2nc, and thus the antichain bound is 
at most an additive logarithmic term greater than the Goemans bound. 

We close the study of nonnegative ranks with a family of polytopes for which all slack 
matrices have constant rank while their nonnegative ranks can grow arbitrarily high. 

Example 4.14. Let S'„ be the slack matrix of a regular n-gon in the plane. Then rank(S'„) = 



3 for all n, while, by Corollary 4.13, rank_|_(S'„) > log2(n). 



The above lower bound is of optimal order since a regular n-gon has a M^-lift where 
k = 0(log2(n)) by the results in [6]. 

The psd rank of a nonnegative matrix or convex body seems to be even harder to study 
than nonnegative rank and no techniques are known for finding upper or lower bounds for 
it in general. Here we will derive some coarse complexity bounds by providing bounds for 
algebraic degrees. To derive our results, we begin with a rephrasing of part of |2Bl Theorem 
1.1] about quantifier elimination. 

Theorem 4.15. Given a formula of the form 

3yGM™-" : g,{x,y)>0 Vz = l,...,s 

where x G M" and gi G ]R[x, are polynomials of degree at most d, there exists a quantifier 
elimination method that produces a quantifier free formula of the form 

I Ji 

(1) y /\{h.,ix)A,,o) 

i=l j=l 
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where hij G M[x], Aij G {>, >, =, 7^, <, <} such that 

and the degree of hij is at most (sd)^^"^~'^\ where K is a constant. 

The following result of Renegar on hyperbolic programs offers a semialgebraic description 
by k polynomial inequalities of degree at most k, of an affine slice of a (a spectrahedron) 
that contains a positive definite matrix. 

Theorem 4.16. ^ Let Q = {z E R"" : C + Y^^i^i ^ 0} k a spectrahedron with E : = 
C + ^ z[Ai >- for some z' G Q, and C, Ai are symmetric matrices of size k x k. Then Q is 
a semialgebraic set described by g^Kz) >Ofori = l,...,k where g^'^^z) := det(C + ^ ZiA,) 
and g^'^\z) is the i-th Renegar derivative of g'^'^\z) in direction E. 

With these two results, we can give a lower bound on the psd rank of a full- dimensional, 
convex, semi-algebraic set C . The Zariski closure of the boundary of C is a hypersurface 
in since the boundary of C has codimension one. We define the degree of C to be the 
degree of a minimal degree (nonzero) polynomial whose zero set is the Zariski closure of the 
boundary of C. By construction, this polynomial vanishes on the boundary of C . 

Proposition 4.17. If C '^W^ is a full- dimensional convex semialgebraic set with a S^-lift, 
then the degree of C is at most /^^(fc^n) ^ 

Proof: We may assume that C has a proper i5^-lift since otherwise we can restrict to a face 
of and obtain a iS!^-lift with r < k. Hence there is an affine subspace L that intersects 
the interior of 5^ such that C = 7f{S^ fl L). This implies that there exist k x k symmetric 
matrices Ai, . . . , An, Bn+i, ■ ■ ■ , and a positive definite matrix Aq such that 

L = |Ao + + {x,y) G M" X M'"-"} , 

and 7r(Ao + Y.XiAi + Y.yjBj) = (xi, . . . ,x„). Let 

Q = {{x,y) G M" X M™-" : Ao + + 5^^^^^' ^ ^} ' 

Then by Theorem |4.16| Q is a basic semialgebraic set cut out by the k Renegar derivatives, 
gi{x,y) > 0, of det(y4o + Yl ^i^i + Yl Vj^j)^ with the degree of each gi at most k. 

Since C is the projection of Q, by the Tarski-Seidenberg transfer principle [21J, C is again 
semialgebraic and has a quantifier free formula of the type ([T]). Hence the boundary of C is 
described by at most (/^2^x(m-n)(n+i) polynomials of degree at most where K is 

a constant. Since m < (^^^) < k'^, by multiplying all those polynomials together we get a 
polynomial vanishing on the boundary of C of degree at most (/;;)2X(fc2-n)(n+2) _ j^o(k'^n)^ q 

The above result provides bounds on the psd ranks of polytopes. 

Corollary 4.18. If C G M" is a full- dimensional polytope whose slack matrix has psd rank 
k, then C has at most k^'^^ facets. 



4.17 



Proof: If the psd rank of the slack matrix of C is A; then C has a iS^-lift. By Proposition 
the degree of C is then at most Since the minimal degree polynomial that vanishes 

on the boundary of a polytope is the product of the linear polynomials that vanish on each 
of its facets, the degree of C is the number of facets of C . □ 
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This shows that even for slack matrices of polytopes there is no function of rank that 
bounds psd rank. 



Example 4.19. As in 4.14[ let S'„ be the slack matrix of a regular n-gon in the plane. Then 



by Proposition 4.17, rankpsd{Sn) grows to infinity as n increases. But as we have seen before, 



rank(S'„) = 3 for all n. 

In this section, we have shown that the gap between all pairs of ranks: rank, rank_|_ and 
rankpsd can become arbitrarily large for nonnegative matrices. For slack matrices of polytopes 
we have given examples where the gaps between rank and rank_|., and rank and rankpsd, can 
also grow arbitrarily large. However, no family of slack matrices are known for which rank_|_ 
can become arbitrarily bigger than rankpg^ or at least exponentially bigger. Such a family 
would provide the first concrete proof that semidefinite programming can provide smaller 
representations of polytopes than linear programming. 

5. Applications 

5.1. Stable set polytopes. An interesting example of polytopes that arise from com- 
binatorial optimization is that of stable set polytopes. Let G be a graph with vertices 
V = {1, . . . ,n} and edge set E. A subset 5" C ^ is stable if there are no edges between 
elements in S. To each stable set 5* we can associate a vector xs G {0, 1}*^ where {xs)i = 1 
if i E S and {xs)i = otherwise. The stable set polytope of the graph G is the polytope 

STAB(G') = corLv{xs : 5" is a stable set of G}. 

Finding the largest stable set in a (possibly vertex-weighted) graph is a classic NP-hard 
problem in combinatorial optimization that can be formulated as linear optimization over 
STAB(G'). The polytopes STAB(G) give rise to one of the most celebrated results in semi- 
definite lifts of polytopes. Recall that a graph is perfect if the chromatic number of every 
induced subgraph equals the size of its largest clique. 

Theorem 5.1. [20j Let G be a perfect graph with n vertices, then STAB(G') has a S'^^-lift. 

The proof is by explicit construction. Suppose X G has rows and columns indexed 
by 0, 1, . . . ,n. Lovasz showed that when G is perfect, the cone 5"^^ sliced by the planes 
given by 

Xo,o = 1, X,,i = Xo,i V I, X,,, = V (z, j) e E, 

and projected onto the coordinates Xj^j for i = 1, . . . ,n, is exactly STAB(G). If G is not 
perfect this construction offers a convex relaxation of STAB(G') called the theta body of G. 
In [30j, Yannakakis showed that if G is perfect, STAB(G') has a M^-lift where k = n^(i°s 
It is an open problem as to whether STAB(G), when G is perfect, admits a polyhedral 
lift of size polynomial in the number of vertices of G. Such a result is plausible since one 
can find a maximum weight stable set in a perfect graph in polynomial time by semidefinite 
programming over the above lift. On the other hand, it would also be interesting if STAB(G) 
does not admit a polyhedral lift of size polynomial in n when G is a perfect graph. Such a 
result would provide the first example of a family of discrete optimization problems where 
semidefinite lifts are appreciably smaller than polyhedral lifts. In fact, until recently no 
explicit family of graphs was known for which STAB(G) does not admit a polyhedral lift of 
size polynomial in the number of vertices of G. In ^12j, the authors construct non-perfect 
graphs G with n vertices for which rank_|_(STAB(G)) is 2^^"^ 
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In the context of Theorem 5J^, a natural question is whether there could exist a positive 
semidefinite lift of the stable set polytope of a perfect graph to some iS^ where k < n + 1. 
The next theorem settles this question. 

Theorem 5.2. Let G he any graph with n vertices. Then STAB(G') does not admit a S^-lift. 



Proof: Using Theorem 3.3 it is enough to show that the slack matrix of STAB(G) has no 
iS"-factorization. Furthermore we may restrict ourselves to a submatrix of the slack matrix. 
Consider the subset V of vertices of STAB(G') consisting of the origin and all the standard 
basis vectors ei,. . . ,e„. The set V is in the vertex set of every stable set polytope since 
the empty set and all singleton vertices are stable in any graph. Consider also a set of 
facets F' containing some facet that does not touch the origin, and all n facets given by the 
nonnegativities Xj > 0. The submatrix of the slack matrix whose rows are indexed by V 
and columns by F' has the block structure 

S' On 
\*n -'n 

where *n is some unknown n x 1 vector, 0„ the zero vector of size 1 x ri and /„ the n x n 
identity matrix. Suppose S' has a iS" factorization with Aq, . . . ,An G 5" associated to 
rows and Bq, . . . ,Bn G iS" associated to columns. By looking at the first row of S' we see 
(Aq, Bi) = for all i > 1 which implies AoBi = for alH > 1 since all matrices are psd. 
Therefore, the columns of each B^ are in the kernel of Aq for i > 1. Since Aq is a nonzero 
n X n matrix, its kernel has dimension at most n — 1, and contains all columns of B^ for 
i = 1, . . . ,n. By a dimension count we get that all the columns of one of the B^, say B^, are 
in the span of the columns of B^, i > 1 and i ^ k. Consider now A^. Again, A^Bi = for 
alH > 1 and i k, which implies that all columns of those B^ are in the kernel of A^. But 
this implies that so are the columns of Bk- Therefore, {Bk,Ak) = which contradicts the 
structure of 5". □ 

Remark 5.3. (1) In fact, the above proof shows that any polytope in M" that has a 
vertex that locally looks like a nonnegative orthant has no iS"-lift. Recently, it has 
been shown [16j that the psd rank of a n-dimensional polytope in is at least n + 1. 



(2) The result in Theorem 5.2 is simple, and yet remarkable in a couple of ways. First, 



it is an illustration of the usefulness of the factorization theorem (Theorem 2.4) to 
prove the optimality of a lift. Secondly, it is impressive that the simple and natural 
semidefinite lift proposed by Lovasz is optimal in this sense. 
(3) Theorem 4.2 in [15] implies that any ra-dimensional polytope with a 0/1 -slac k matrix 



admits a iS""'"^-lift. A simple proof of this fact follows from Proposition 4.8 since the 
rank of a slack matrix of a polytope in M" is at most n + 1. 

We close this subsection with an interesting class of lifts of stable set polytopes to com- 
pletely positive cones. Recall that C* is the cone of n x n completely positive matrices. 

Theorem 5.4. [9J For any graph G with n vertices, the polytope STAB(G) has a C^j^i-lift. 

Proof: This is an immediate consequence of Proposition 3.2 in [9j applied to this problem. 

□ 

The C*_^^i-lift of STAB(G') is given by the same linear constraints on X G C^^i that were 
used to construct the iS"^^-hft. These lifts are of very small size and work for all graphs, but 
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have hmited interest in practical computations since copositive/completely positive program- 
ming is not known to have any efficient algorithms. We illustrate the copositive/completely 
positive factorization that is expected for this lift in the case of a 5-cycle. 



Example 5.5. From Theorem |5.4 we know that the stable set polytope of a 5-cycle has 
a Cg-lift, and hence by Theorem 2.4, its slack matrix must have a Cg-factorization. This 
polytope has 11 vertices: the origin, the five standard basis vectors ei, . . . ,65 and the five 
sums ei + 63,62 -|- 64,63 + 65,64 + 61,65 + 62 corresponding to the five stable sets of the 
5-cycle with two elements. We will denote these last five vertices by Si, . . . , S5, respectively. 
Furthermore, there are 11 facets for this stable set polytope given by the inequalities: 



X. 



+ < 1, 



V 



,5, 



and 



<2 



where we identify xq with xi. 

Since we know a Q-lift, the A map that takes vertices of STAB(G) to Q is easy to 
get. Send each vertex w G to A{v) = {l,v)'^{l,v) G M^^^, and since all coordinates 
are nonnegative, A{v) is completely positive. For the copositive lifts of the facets, we go 
case by case. For Xj > take the matrix (0, 6j)"^(0, 6j), while for 1 — Xj — Xj+i > take 
(1, — 6j — 644.1)^(1, — 6j — 6j+i). All these matrices are positive semidefinite and hence also 
copositive. It is also easy to check that they satisfy the factorization requirements. 

It remains to find a copositive matrix for the odd-cycle inequality 2 — Yl^j=i — 0- This 
is non-trivial, but it can be checked that the following matrix works for the factorization: 



/ 2 



-1 -1 -1 -1 



v 



1 
1 




1 



1 
1 
1 






1 
1 
1 






1 
1 
1 



-1 

1 





1 

1 



To see that it is copositive, by Theorem 2 in [Hj, we just have to show that 

T 



/ 1 


1 








1 \ 




-1 \ 




-1 \ 


1 


1 


1 










-1 




-1 





1 


1 


1 


- 




-1 




-1 








1 


1 


1 




-1 




-1 










1 


1/ 


v 


-1/ 


v 





v 



-1 
1 
1 
1 

-1 



1 \ 



is copositive, and this is a well known Horn form, that is copositive. 
instance, Lemma 2.1 in jl]. 



For a proof, see for 



5.2. Rational lifts of algebraic sets. Our last application is an interpretation of Theo- 
rem |2.4| for an important class of positive semidefinite lifts, called rational lifts, of zero sets 
of polynomial equations. Suppose we have a system of polynomial equations 

(2) = p2(a;) = ■ ■ ■ = = 

where the p^'s have real coefficients and n variables, and I is the ideal they generate in the 
polynomial ring ]R[x] = ]R[xi, . . . ,Xn\- The set of zeros of ([2]), denoted by Vir(/), is the real 
variety of the ideal /, and we consider positive semidefinite lifts of C = conv(ViR(/)). Since 
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different polynomial systems can generate the same convex hull, we define the convex radical 
ideal of I to be the ideal ''°V7 of polynomials vanishing on Vr(/) H ext(C). Replacing I by 
does not change C and so we will, to simplify arguments, assume that / = 

We consider special kinds of iS_^-factorizations of the slack operator Sc-, namely, those 
where the map A : ext(C) — )■ S'^ is of the form A{x) = v{x)v{x)'^ , where v{x) is a vector 
of rational functions v{x) = {vi{x), . . . By factoring out the common denominators, 

we can rewrite such a map as A{x) = ^^^^w{x)w{x)'^ where w{x) is a vector of polynomials. 
We say that A is a rational map, and if p{x) = 1 we say that A is a polynomial map. A 
i5^-factorization of Sc is called a rational (respectively, polynomial) factorization if the map 
A used in the factorization is a rational (respectively, polynomial) map. 

These lifts turn out to be related to the sums of squares techniques for lift-and-project 
methods. Given a polynomial q{x) G ]R[x], we say that it is a sum of squares (sos) modulo 
/, if there exist polynomials /ii(x), . . . , hs{x) G M\x\ such that q{x) — ^ hi{xY G /. If the 
degrees of all the hi are bounded above by k we say that q is k-sos modulo I. This is a 
sufficient condition for nonnegativity over a real variety that has been used to construct 
sequences of semidefinite relaxations of the convex hull of the variety. One such hierarchy is 
given by the theta bodies of J, introduced in [T3]. They are defined geometrically by taking 
the k-th theta body relaxation of conv(ViR(/)), denoted as THfc(J), to be the intersection of 
all half-spaces {x : £{x) > 0} where i{x) is a linear polynomial that is k-sos modulo /. 

Theorem 5.6. Let I be a convex radical ideal and Z = Vr(/) its zero set such that conv(Z) 
is compact and contains the origin. Then, 

(1) the slack operator o/conv(Z) has a rational factorization with A{x) = :^^^w{x)w{x)'^ 
in for all x G ext(conv(Z)) if and only if, for every linear polynomial i{x) non- 
negative over Z , p{x)^i{x) is a sum of squares modulo I , with all the polynomials in 
the sum of squares being linear combinations of the entries ofw{x). 

(2) The slack operator o/conv(Z) has a polynomial factorization with A{x) = w{x)w{x)'^ 
where the degree of each entry in w at most k if and only z/THfc(/) = conv(Z). 

Proof: For the first part note that since any linear polynomial i{x) nonnegative over Z 
is a convex combination of extreme points of the polar of conv(Z), there exists a matrix 
Bi G 5^ such that i{x) = {Bi,A{x)) for all x G ext(conv(Z))). Since / is convex radical 
this actually implies £{x) = {Bi,A{x)) modulo /, and by rewriting the right hand side we 
have p{xyi{x) = w{x)'^ Biw{x) modulo /, which is a sum of squares modulo the ideal with 
the conditions we want. Since all steps in the proof are actually equivalences, this gives us 
a proof of the first statement. 

For the second statement just note that from [15], / is TH^-exact if and only if all linear 
polynomials non-negative over Vk(/) are k-sos modulo / (since I is in particular real radical). 
Now use the first statement to conclude the proof. □ 

A rational factorization of the slack matrix of C := conv(VM(/)) consists of two maps A 
and B that assign psd matrices to extreme points of C and C°. On the primal side, every 
extreme point (and hence every point) of C is being lifted to a psd matrix via the map 
A. On the dual side, B is assigning a psd Gram matrix to every linear functional that is 
nonnegative on Vir(/) certifying its sum of squares property with respect to this variety. 

Several further remarks are in order. The requirements that conv(Z) is compact and 
contains the origin in its interior are not essential and are assumed for the sake of simplicity 
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and to keep the discussion in the same setting as in our main theorems. A similar idea could 
be applied to convex hulls of sets defined by polynomial inequalities, but there the usual lift 
is not to a positive semidefinite cone but to a product of such cones, making the notation 
more cumbersome. Finally, the condition that the ideal / is convex radical can be avoided if 
we use a stronger notion of a polynomial lift that implies factorization over the entire variety 
and not just over the extreme points of the convex hull of the variety. 
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